

PROJECTION DISPLAY APPARATUS, DISPLAY METHOD FOR 
SAME AND IMAGE DISPLAY APPARATUS 

5 A- Ci^^ Teefemeat^ieW^ 

The present invention relates to an image display apparatus, particularly 
to a projection display apparatus technology that project images onto a screen 
based on given image data. 

fi^ 1 OjV^n ph^r^ O^Hve. baLk^rDiMrd Packground .\i't 
111 The ability of projection display apparatuses to display enlarged given 

images on a projection screen has led to their extensive use in presentations. In 
hu a presentation an explanation is provided based on projected images, so it is 

convenient to be able to overlay the images with an embellishment effect image 
15 (embelUshment image) such as an arrow graphic or the hke to indicate specific 
;jf locations on the projected image. 

In prior art projection display apparatuses, when, for example, an 
embellishment effect image is overlaid on an original image given from a personal 
computer, the embellishment effect image has been overlaid in the personal 
2 0 computer. Based on overlay image signals output fi:om the personal computer, 
the projection display apparatus displays on the projection screen the image on 
which the embellishment effect image is overlaid. However, in this case, it has 
been necessary for a specific apphcation program to be installed beforehand in 
the personal computer for performing processing based on commands from the 
2 5 projection display apparatus. Moreover, when signals given to the projection 
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display apparatus are image signals output from a video recorder or television, 
it has not been possible to overlay an embellishment effect image on the original 
image. That is, a problem has been that whether or not an embellishment effect 
can be imparted to a projected image has depended on the capabilities of the 
image supply apparatus that supplies an image to the projection display 
apparatus. 



^DiflcloourG of tho Invention 



This invention was accomplished to resolve the foregoing problems of the 

p 10 prior art, and has as its object to provide a technology that enables projection 

m images to be overlaid with embellishment effects without depending on the 

|== capabilities of the image supply apparatus. 

^11 To resolve at least part of the above problems, a first projection display 

^L. ^ apparatus of the present invention comprises: an embelUshment effect memory 

iff 1 5 for storing embelhshment effect data representing an embellishment effect image 

e - s 

•J; that can be used to embellish an arbitrary image; an image embellishment 

section that generates embelhshed image data by overlaying an original image 
represented by the given image data and the embelhshment effect image; a light 
modulation unit that is driven in response to the embelhshed image data pixel 

2 0 by pixel; and an optical system for projecting onto the screen the embelhshed 
image obtained by the hght modulation unit. 

Since this projection display apparatus is equipped with an image 
embelhshment section for overlajdng the embelhshment effect images internally, 
it is able to overlay the embellishment effect images internally without having 

2 5 to rely on the capabilities of an image supply apparatus. 
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In the projection display apparatus, the image embelhshment section may 
comprise an image overlay section that overlays the embellishment effect image 
at a specified location on the original image. 

Doing this makes it possible for the image overlay section to be used to 
5 overlay an embellishment effect image at a desired position on an original image, 
thereby increasing the degree of embellishment effect image overlay freedom. 

In accordance with another preferable application of the projection display 
apparatus, the embellishment effect memory stores a plurahty of embellishment 
effect data representing a plurahty of embelhshment effect images; and the 
10 image overlay section superimposes at least one selected embelhshment image 
at each specified position on the original image. 

Doing this makes it possible to select any desired embellishment effect 
image from among a plurality of embelhshment effect images, enabling more 
effective embellishment effect image to be selected and overlaid on the original 
15 image. 

In the projection display apparatus, it is preferable for the image overlay 
section to include an embelhshment effect bitmap memory for storing 
embellishment effect bitmap data obtained from the embelhshment effect data; 
a synthesizer section that generates the embellished image data by synthesizing 

20 the given image data and the embelhshment effect bitmap data read from the 
embelhshment effect bitmap memory; and a frame memory for storing the 
embelhshed image data, the frame memory having at least a memory area 
corresponding to all the pixels of the hght modulation unit, the embeUished 
image data read out from the frame memory being provided to the Ught 

2 5 modulation unit. 
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Since in this projection display apparatus the embellished image data in 
which the embellishment effect image is overlaid on an given original image is 
written into the frame memory, embelUshed images can be obtained by reading 
out embellished image data from the frame memory. 
5 Alternatively, the image overlay section in the projection display 

apparatus can include an embellishment effect bitmap memory for storing 
embellishment effect bitmap data obtained from the embelhshment effect data; 
a frame memory for storing the given image data, the frame memory having at 
least a memory area corresponding to all the pixels of the Ught modulation unit; 

10 and a synthesizer section that generates the embellished image data by 
synthesizing image data read from the frame memory and the embellishment 
effect bitmap data read from the embelhshment effect bitmap memory, the 
embellished image data synthesized by the synthesizer section being provided to 
the light modulation unit. 

15 This projection display apparatus also enables embelhshed image data to 

be obtained and has the same function and advantage as the above projection 
display apparatus. However, while in the above projection display apparatus 
embelhshed image data is read from a frame memory and displayed, in this 
projection display apparatus embelhshment effect images are overlaid as the 

20 image data written to the frame memory is being read out, enabling the time 

from the command to overlay the embellishment effect image to the display of the 
embelhshed images to be shortened. 

In the above projection display apparatus, the synthesizer section may 
comprise a data selector that selects either one of the image data and the 

25 embelhshment effect bitmap data, pixel by pixel, to produce the embellished 
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image data. 

Since in this projection display apparatus the dala selector selects either 
image data or embellishment effect bitmap data, an embelHshment image can be 
overlaid on an original image by substituting embellishment effect bitmap data 
5 for a portion of the image data. 

Alternatively, the synthesizer section of the above projection display 
apparatus may comprise a multiplier section that multiples the image data and 
the embellishment effect bitmap data by respective coefficients on a pixel by pixel 
basis; and an adder section that adds the embellishment effect bitmap data and 
10 the image data thus multipUed by the multiplier section, on a pixel by pixel basis. 

In this projection display apparatus, the density (brightness) ratio between 
embellishment effect images and original images can be adjusted by setting the 
coefficients appropriately. 

It is also desirable for the synthesizer section of the projection display 
15 apparatus to include a coefficient setting section that controls the coefficients in 
the multipUer section so as to change a synthesis ratio between the image data 
and the embellishment effect bitmap data, thereby adjusting a degree of 
transparency of embellishment effects. 

By doing this, the degree of transparency of embellishment effects can be 
20 changed by controlling the coefficients of the multiplier section. 

In the above projection display apparatus, the coefficient setting section 
may change the coefficients in the multiplier section with time so as to change 
the synthesis ratio between the image data and embellishment effect bitmap data, 
thereby changing the degree of transparency of the embellishment effects with 
25 time. 
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By doing this, the degree of transparency of embellishment effects can be 
changed with time by changing the coefficients of the multipher section with time. 

A second projection display apparatus according to the invention 
comprises: a frame memory for storing given original image data; a first 
embellishment memory for storing a fi.rst embellishment image data representing 
a first embellishment image having a shape and size that can be set; a second 
embellishment memory for storing a second embellishment image data 
representing a second embellishment image having a size that can be altered 
while a shape is maintained similar; an image embellishment section that 
generates embellished image data representing embellished image by overlaying 
an original image represented by the original image data with at least one of the 
first embellishment image and the second embellishment image; an image 
display signal generator for generating image display signals based on the 
embellished image data; an electro -optical device for emitting Ught that forms 
images in response to the image display signals; and a projection optical system 
for projecting light emitted by the electro-optical device. 

Since this projection display apparatus is equipped with an image 
embellishment section for overlaying embellishment image on original image, the 
projection display apparatus is able to overlay the embellishment images 
internally so it can be made to overlay the embellishment image on a given 
original image without having to rely on the capabiUties of the image supply 
apparatus. Moreover, the ability to overlay the original image with at least one 
selected from the first embellishment image in which the shape and size can be 
set, and the second embellishment image in which a shape can be maintained 
similar while the size is altered, enables more effective embellishment of original 



images to be implemented. 

In accordance with another preferable application of the projection display 
apparatus, the first embellishment memory has a memory space to hold 1/n 
(where n is an integer of at least 1) lines and 1/n pixels of the frame memory and 
5 stores the first embellishment image data in an area corresponding to the 
position at which the first embellishment images are to be superimposed; and the 
second embellishment memory stores the second embellishment image data and 
stores at least coordinate data indicating the overlay position thereof the original 
image. 

10 With this configuration, embellished image data can be obtained by 

overlaying the original image data read from the frame memory with at least one 
selected from the first embellishment image data read from the first 
embellishment memory and the second embellishment image data read from the 
second embellishment memory. Moreover, the embellishment image can be 

15 superimposed on the original image without changing the original image data 
written to the frame memory. 

In the above projection display apparatus, it is preferable for n to be an 
integer of at least 2. 

Since this enables the first embelUshment images can be stored using a 

20 smaller storage capacity than the frame memory, it is advantageous for reducing 
the size of the apparatus. 

In above projection display apparatus, it is preferable for the image 
embelUshment section to be provided with a multiplier section that multiples the 
original image data read from the frame memory and one of the first 

25 embelUshment image data from the first embelUshment memory and the second 
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embellishment image data from the second embellishment memory by respective 
coefficients on a pixel by pixel basis; and an adder section that adds one of the 
first embelHshment image data and the second embellishment image data and 
the original image data multiplied by the respective coefficients, pixel by pixel 
5 Doing this enables the density (brightness) ratio between an original 

image and either one of the first embelhshment image and the second 
embellishment image to be adjusted by setting the coefficients appropriately. 

It is also desirable for the image embelhshment section to include a 
coefficient setting section that controls the coefficients in the multiplier section 

10 so as to change a synthesis ratio between the original image data and one of the 
first embellishment image data and the second embellishment image data, 
thereby adjusting a degree of transparency of embellishment effects. 

By doing this, the degree of transparency of the first and second 
embellishment images can be changed by controlling the coefficients of the 

1 5 multiplier section. 

It is also preferable for the projection display apparatus to be equipped 
with a storage memory for storing a plurality of embellishment image data as the 
second embellishment image data; wherein the second embelHshment memory 
stores at least one embelhshment image data selected from the storage memory. 

20 In this way, original images can be overlaid with more effective 

embelhshment images by selecting a desired embellishment image from among 
a plurality of embellishment image data prepared beforehand. 

It is also preferable for the image embelhshment section of the projection 
display apparatus to include a drawing section that draws the first 

25 embelhshment image based on set drawing conditions; the drawing section 
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drawing the first embellishment image in the first embellishment memory based 
on at least a shape and position of the first embellishment image set by a user 
using a drawing instruction image which is one of the second embellishment 
images selected for setting conditions for drawing the first embellishment image. 
5 This makes it possible to readily set a shape and position of a first 

embellishment image to be drawn by the drawing section, by using drawing 
instruction image comprised by the second embellishment images selected to set 
the conditions for drawing the first embellishment image. 

In this projection display apparatus, also, when the shape and position of 

10 the first embellishment image are to be set by using at least two drawing 
instruction images, the drawing section selects the at least two drawing 
instruction images having associated shapes which indicate the shape and 
position of the first embellishment image concerned, reads out the selected 
drawing instruction images from the storage memory and stores them in the 

15 second embellishment memory. 

When setting the first embelhshment image, this enables a user to readily 
ascertain the shape and position and the like of the first embelhshment image. 

A first image display apparatus of this invention comprises: a frame 
memory for storing given original image data; a first embelhshment memory for 

2 0 storing a first embelhshment image data representing a first embellishment 
image having a shape and size that can be set; a second embelhshment memory 
for storing a second embellishment image data representing a second 
embelhshment image having a size that can be altered while a shape is 
maintained similar; an image embelhshment section that generates embelhshed 

2 5 image data by overlaying an original image represented by the original image 
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data with at least one of the first embellishment image and the second 
embelUshment image; an image display signal generator for generating image 
display signals based on the embellished image data; and an electro-optical 
device for emitting light that forms images in response to the image display 
5 signals. 

This image display apparatus has the same function and advantage as the 
above projection display apparatus and can overlay an original image with 
embellishment image without having to rely on the capabihties of an image 
supply apparatus. It can also effect more effective embellishment of an original 
10 image. 

A first display method of this invention is a method that uses a projection 
display apparatus with a light modulation unit to display an image based on 
image data given to the projection display apparatus by projecting the image onto 
a screen, which comprises the steps of: preparing embellishment effect data 

15 representing an embellishment effect image that is used to embellish an 
arbitrary image; generating embelUshed image data representing embelUshed 
image by overlaying an original image represented by the given image data and 
the embellishment effect image; driving the light modulation unit in response to 
the embellished image data pixel by pixel; and projecting onto the screen the 

2 0 embelUshed image obtained by the hght modulation unit. 

Using this method also provides the same function and advantage as the 
first projection display apparatus of the invention, enabhng a given original 
image to be overlaid with embellishment images without having to rely j^n the 
capabilities of the image supply apparatus. 

2 5 A second display method of this invention is a method of displaying an 
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image obtained by embellishment of original image data given to a projection 
display apparatus, which comprises the steps of: storing given original image 
data; storing a first embellishment image data representing a first embellishment 
image having a shape and size that can be set; storing a second embellishment 
5 image data representing a second embellishment image having a size that can be 
altered while a shape is maintained similar; and generating embellished image 
data representing embellished image by overlaying an original image represented 
by the original image data with at least one of the first embellishment image and 
the second embellishment image. 

10 Using this method provides the same function and advantage as the 

second projection display apparatus of the invention, enabling a given original 
image to be overlaid with embellishment images without having to rely on the 
capabilities of the image supply apparatus. 

A display control method of the present invention is a display control 

15 method of a projection display apparatus that displays embellishment image 
overlaid on a given original image, which comprises the steps of: using a remote 
controller so as to display a menu screen overlay; using the remote controller so 
as to select from the menu a desired embellishment image among a plurality of 
embellishment images and an embelUshment image display condition such as 

20 color; erasing the menu screen and displaying an overlay of the selected 
embelhshment image and a display pointer image symbolizing the display 
condition; using the remote controller so as to move the display pointer image 
and display an overlay of a starting pointer image at a starting position 
determined for the embellishment image; and using the remote controller to 

25 again move the display pointer image and determine an end position of the 
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embellishment image to display an overlay of the embellishment image between 
the starting position and the end position determined for the embellishment 
image. 

This enables a person using the projection display apparatus to make a 
5 presentation to remotely overlay an embelhshment image at a point on the 
original image to which he wishes to draw attention. When there are a plurality 
of embellishment images available, using pointer images (icons) that represent 
an embellishment image type and display conditions such as color facilitates 
operation. Controlling the display of embellishment images can be further 
10 facilitated by using starting pointer images that symbolize the type of 



embellishment image and the display conditions (color, line width, etc.). 

In the above display control method, the starting position pointer images 
may comprise a pluraUty of pointer images that indicate a direction of the 
embellishment image overlay, and when the display pointer image is moved, one 



15 pointer image is selected from the plurality of pointer images based on a direction 



In the above display control method, also, the embelhshment image 
represents at least one of a Hne and area whose color can be selected from a 
plurality of colors, and at least the display pointer image is displayed overlaid as 
20 an image having a color corresponding to the selected color. 

This type of image display can make it easier for a user to control an 
embelhshment image displayed overlaid on an original image. 



A computer program recorded on a recording medium can be used to 
enable at least part of the functions of the steps and parts described in the 
25 foregoing to be implemented by a computer. 



in which the display pointer image is moving relative to the starting position. 
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Brief Description of the Drawings 
Fig. 1 is a block diagram for schematically illustrating the general 
configuration of a projection display apparatus that is a first embodiment of this 
5 invention. 

Fig. 2 is a block diagram for schematically illustrating the configuration 
of a video signal conversion circuit 10. 

Fig. 3(a)-(c) are diagrams for explaining an embellishment effect memory 
24, embellishment effect bitmap memory 26 and frame memory 22 used in the 
10 invention. 

Fig. 4 is a block diagram for schematically illustrating the configuration 
of an embellishment overlay circuit 12. 

Fig. 5(a)-(c) are diagrams for explaining the overlay operation of image 
data stored in the frame memory 22 and embelhshment effect bitmap data BMDl 
15 stored in the embelhshment effect bitmap memory 26. 

Fig. 6 is a diagram for explaining the embelhshment effect bitmap data 
BMDl expanded in the embellishment effect bitmap memory 26. 

Fig. 7(a)-(c) are diagrams for explaining examples of displays on a 
projection screen 104 of original images input fi:om a personal computer that 
20 have been overlaid with embellishment images. 

Fig. 8(a)-(c) are another diagrams for explaining the displays on a 
projection screen 104 of original images input from a personal computer that 
have been overlaid with embellishment images. 

Fig. 9 is a diagram for explaining the embelhshment effect bitmap memory 
25 26 when the embeUishraent images of Fig. 7 (b) are being expanded. 
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Fig. 10(a) and 10(b) are diagrams for explaining projected images overlaid 
with transparent embellishments. 

Fig. ll(a)-(c) are diagrams for explaining the positioning of embellishment 
images when part of the image is enlarged. 
5 Fig. 12 is a block diagram for schematically illustrating the general 

configuration of a projection display apparatus that is a second embodiment of 
this invention. 

Fig. 13 is a block diagram for schematically illustrating the configuration 
of a video signal conversion circuit 60. 
10 Fig. 14 is a diagram for explaining a data selector 64 of a video processor 

62. 

Fig. 15 is a block diagram for schematically illustrating the general 
configuration of a projection display apparatus that is a third embodiment of this 
invention. 

15 Fig. 16 is a block diagram for schematically illustrating the configuration 

of a video signal conversion circuit 210. 

Fig. 17 is a block diagram for schematically illustrating the configuration 
of an embellishment overlay circuit 212. 

Fig. 18(a) and 18(b) are diagrams for explaining an embellishment image 
20 expansion memory 226 and an embellishment image drawing memory 227. 

Fig. 19 is a diagram for explaining a menu screen displayed by a user 
operating a remote controller 29. 

Fig. 20(a)-(c) are diagrams for explaining overlay image data SDVl formed 
by overlaying image data DV2 with first embellishment image data DBMD. 
25 Fig. 21(a)-(c) are diagrams for explaining the embellished image data 
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SDV3 formed by the overlay image data SDVl overlaid by the second 
embellishment image data SBMD. 

Fig. 22(a)-(c) are diagrams for explaining examples of displays on the 
projection screen 104 of images input from a personal computer that have been 
5 overlaid with embellishment images of a specific shape stored in the 
embellishment image storage memory 224. 

Fig. 23(a)-(c) are diagrams for explaining examples of displays on the 
projection screen 104 of images input from a personal computer that have been 
overlaid with embellishment images drawn by the CPU 20. 
10 Fig. 24(a)-(c) are diagrams for explaining the process of overlaying an 

original image with a square embellishment image. 

Fig. 25(a)-(c) are diagrams for explaining the process of overlaying an 
original image with a square embellishment image. 

Fig. 26(a)-(c) are diagrams for explaining the process of overlaying an 
15 original image with a square embellishment image. 

Fig. 27(a)-(d) are diagrams for explaining the relationship between the 
position SP of a starting pointer BPS, and the position CP of box coordinate 
pointer BP specifying the end point EP. 

Fig. 28(a)-(c) are diagrams for explaining the process of overlaying an 
20 original image with a marker image. 

Fig. 29(a)-(c) are diagrams for explaining the process of overlaying an 
original image with a marker image. 

Fig. 30(a)-(c) are diagrams for explaining the process of overlaying an 
original image with a marker image. 
25 Fig. 31(a)-(c) are diagrams for explaining the process of overlaying an 
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original image with a line image. 

Fig. 32(a)-(c) are diagrams for explaining the process of overlaying an 
original image with a line image. 

(l^S^'^y^ ^^'^^ ' ^Q^^^ Carrying Out the Invention 

A. First embodiment: 

Modes of carrying out the invention will now be explained with reference 
to embodiments. Fig. 1 is a block diagram for schematically illustrating the 
general configuration of a projection display apparatus that is a first embodiment 
10 of this invention. The projection display apparatus includes a video signal 

conversion circuit 10, an embellishment overlay circuit 12, a liquid crystal display 
driver circuit 14, a liquid crystal display panel 16, a frame memory 22, an 
embellishment effect memory 24, an embellishment effect bitmap memory 26, a 
remote control section 28, a CPU 20, an illumination optical system 100 and a 
15 projection optical system 102. The video signal conversion circuit 10, 
embellishment overlay circuit 12, embellishment effect memory 24, remote 
control section 28 and CPU 20 are connected to each other via a bus 1. The liquid 
crystal display driver circuit 14 is also connected to the bus 1, but this is not 
shown in Fig. 1. The hquid crystal display panel 16 is uniformly illuminated by 
2 0 the illumination optical system 100, and images displayed on the liquid crystal 
display panel 16 are projected onto the projection screen 104 by the projection 
optical system 102. The optical systems 100 and 102 are shown in a simpUfied 
fashion. 

The video signal conversion circuit 10 is used to perform analog-digital 
2 5 conversion of analog video signals AVI, write the converted image data into the 
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frame memory 22 and retrieve image data from the frame memory 22. The 
analog video signal AVI can be an RGB signal SI carrying a computer screen 
image, or a composite image signal S2 from a video recorder, TV or the like. 

Fig. 2 is a block diagram for schematically illustrating the configuration 
5 of a video signal conversion circuit 10. The video signal conversion circuit 10 
includes a sync separator 30, an A-D conversion section 32 and a video processor 
34. 

When the analog video signal AVI is a composite image signal S2, the 
sync separator 30 separates the signal S2 into a sync signal SYNC and a 

10 component image signal (analog image signals not including a sync signal) S3, 
The component image signal S3 is comprised of three color signals representing 
the red, green and blue images. If the analog video signal AVI that is received 
is an RGB signal Si, there is no need to use the sync separator 230 since there 
is a separate sync signal input. 

15 The A-D conversion section 32 contains multiple A-D converters for 

converting RGB signals or component image signals output by the sync separator 
30 to image data DVl for each color signal. The conversion timing of the A-D 
converters is controlled by a dot clock DCLK generated in the video processor 34, 
using the sync signal WSYNC. 

2 0 The video processor 34 performs various image processing functions such 

as controlling the input and output of image data to and from the frame memory 
22. Image data DVl from the A-D conversion section 32 is stored in the frame 
memory 22 until required. 

The writing of image data to the frame memory 22 is synchronized by the 

25 sync signal WSYNC. Retrieval of image data from the frame memory 22 and 
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processing of image data DV2 output by the video processor 34 are synchronized 
by a sync signal RSYNC output by the Uquid crystal display driver circuit 14 (Fig. 
1). The sync signals WSYNC and RSYNC are not mutually synchronized, 
although it is also possible to use sync signals WSYNC and RSYNC that are 
5 synchronized. 

The video processor 34 includes a write control signal generator and a read 
control signal generator that are not illustrated. When image data is to be 
written to or read from the frame memory 22, the signal generators generate 
addresses and control signals for output to the frame memory 22. The image 

10 data is written to the frame memory 22 in accordance with the address and 
control signals generated by the write control signal generator, and the data is 
read out of the frame memory 22 in accordance with the address and control 
signals generated by the read control signal generator. Sync signal WSYNC or 
RSYNC is used when generating the addresses and control signals. 

15 The embellishment effect memory 24 (Fig. 1) is used to store data 

representing embellishment images to be superimposed on original image data. 
In this embodiment, the embellishment data is stored in compressed form in the 
embellishment effect memory 24. Embelhshment effect bitmap data expanded 
from the compressed embellishment data is stored in the embellishment effect 

20 bitmap memory 26. 

Fig. 3(a)-(c) are diagrams for explaining an embelhshment effect memory 
24, embellishment effect bitmap memory 26 and frame memory 22 used in this 
embodiment. Fig. 3 (a) shows the memory space in the embelhshment effect 
memory 24, Fig. 3 (b) shows the memory space in the embelhshment effect 

25 bitmap memory 26 and Fig. 3 (c) shows the memory space in the frame memory 
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22. 

As shown, the embelhshment effect memory 24 contains multiple tjrpes of 
compressed embellishment data CPD, and a program for expanding the 
compressed embellishment data CPD in a bitmap format. The program is stored 
5 in the embellishment effect memory 24 starting at memory address 0000. 
Compressed data A, B and C are stored at starting addresses OAOO, OBOO and 
OCOO, respectively. 

The embellishment effect bitmap memory 26 shown in Fig. 3 (b) is used to 
store embelhshment effect bitmap data BMDl (representing a rectangular 

10 embellishment) expanded by the program in the embelhshment effect memory 
24, and coordinate data PD showing the overlay position and extent of 
embellishment images on the original image data. The embellishment effect 
bitmap data BMDl (Fig. 3(b)) is expanded starting from address 0000 of the 
embellishment effect bitmap memory 26. The coordinate data PD is stored 

15 starting at address AAAA, and includes two point coordinates (xl, yl), (x2, y2). 
The first coordinate (xl, yl) denotes the overlay position of the embellishment 
image within the original image data, and the two coordinates (xl, yl), (x2, y2) 
denote the range of the embellishment overlay, meaning the size of the 
embelhshment image overlay. In the frame memory 22, as shown in Fig. 3 (c), 

20 one frame of original image data, a picture of a tree, is stored in a bitmap format. 
The coordinates (xl, yl), (x2, y2) shown in Fig. 3 (c) correspond to coordinates (0, 
0) in the address 0000 of the frame memory 22. These coordinates (xl, yl), (x2, 
y2) correspond to the coordinate data PD of Fig. 3 (b). In Fig. 3 (b), point a at the 
upper left of the embellishment effect bitmap data BMDl corresponds to the 

25 coordinates (xl, yl), and point b at the lower right corresponds to the coordinates 
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(x2, y2). 

With respect to the embeUishment effect bitmap data BMDl, any one of 
the multiple types of embellishment images can be expanded by specifying it. A 
user can also obtain coordinate data PD by specifying an overlay position within 
5 the image data, or an overlay position and overlay range. If just an overlay 
position is specified, coordinates (xl, yl) are determined, and the coordinate data 
(x2, y2) is set based upon predetermined sizes set according to the type of 
embellishment image concerned. When both position and range are specified, 
coordinates (xl, yl) are set according to the overlay position specified, and in 

10 accordance with the overlay range (size) specified, coordinates (x2 + Ax, y2 +Ay) 

are substituted for (x2, y2). This enables the embellishment image to be enlarged 
or reduced to any desired size. Coordinate data PD is discussed in further detail 
later. Although in this embodiment the embellishment effect bitmap data BMDl 
and coordinate data PD are stored in the embellishment effect bitmap memory 

15 26, they can instead be stored in the embelUshment effect memory 24. 

The embellishment overlay circuit 12 overlays original images and 
embellishment images. Specifically, the embellishment overlay circuit 12 
overlays image data DV2 output by the video signal conversion circuit 10 and 
embellishment effect bitmap data BMDl expanded in the embelUshment effect 

20 bitmap memory 26. 

Fig. 4 is a block diagram for schematically illustrating the configuration 
of the embellishment overlay circuit 12. The circuit 12 includes a pair of 
multiphers 40 and 42, one adder 44 and a coefficient setting section 46. The two 
multipHers 40 and 42 and the adder 44 constitute a configuration that is provided 

25 for each of the colors RGB. Image data DV2 output by the video processor 34 is 
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input to the first multiplier 40, and the embellishment effect bitmap data BMDl 
expanded in the embellishment effect bitmap memory 26 is input to the second 
multiplier 42. 

The coefficient setting section 46 is used to set the coefficients kl and k2 
5 of the multipliers 40 and 42. Coefficients kl and k2 can each be set to a value 
from 0 to 1. kl and k2 are usually set at a value the sum of which is 1. The 
coefficients kl and k2 are controlled by the coefficient setting section 46 based on 
the coordinate data PD (Fig. 3 (b)). 

The multipliers 40 and 42 are used to multiply original image pixel data 

10 by a constant factor. In the multiplier 40, the image data DV2 is converted to 
signals multiplied by kl. Similarly, embelHshment effect bitmap data BMDl is 
converted to signals multiplied by k2. The converted data output as image data 
DV3 and embellishment effect bitmap data BMD2 are input to the adder 44. 

The adder 44 is used to add the pixel data of two input image signals. 

15 Thus, in the adder 44 the image data DV3 and the embellishment effect bitmap 
data BMD2 are added and output as embellished image data DDVl. In the 
projection display apparatus according to this first embodiment, the multipliers 
40 and 42, adder 44 and coefficient setting section 46 correspond to the 
synthesizer section in the fi.rst projection display apparatus of this invention. 

20 The embellished image data DDVl output by the embelUshment overlay 

circuit 12 is supplied to the liquid crystal display driver circuit 14 (Fig. 1). The 
liquid crystal display driver circuit 14 displays on the liquid crystal display panel 
16 the image with the embelHshment overlay corresponding to the embellished 
image data DDVl. The image displayed on the Hquid crystal display panel 16 is 

25 projected onto the projection screen 104 by the optical systems 100 and 102. 
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More specifically, light incident onto the Uquid crystal display panel 16 by the 
illumination optical system 100 is modulated in accordance with image data 
supplied to the liquid crystal display panel 16, and the hght exiting fi:om the 
liquid crystal display panel 16 is projected onto the projection screen 104 by the 
5 projection optical system 102. The Uquid crystal display panel 16 corresponds to 
the light modulation unit in the first projection display apparatus of this 
invention. 

The projection display apparatus is controlled by the remote control 
section 28 in accordance with commands fi'om the remote controller 29. What the 

10 remote control section 28 controls is mainly processing related to embellishment 
effects. In accordance with commands received from the remote controller 29, 
this includes selecting the type of embellishment image and controlling the 
overlay position and size of embellishment images, and whether embellishment 
images are displayed or not. 

15 Instead of hardware, the functions of the video signal conversion circuit 10, 

embellishment overlay circuit 12 and remote control section 28 can be reahzed 
by a computer program. The computer program for realizing the functions of 
these parts can be provided in a format recorded on a computer-readable 
recording medium such as floppy disk, CD-ROM or the like. The program is read 

2 0 off the recording medium by the computer (projection display apparatus) and 
transferred to an internal storage device or an external storage device. 
Alternatively, the computer program may be supplied from a program supply 
apparatus via a communication route. When reahzing the computer functions, 
a computer program stored in an internal storage device is executed by the 

25 computer CPU (microprocessor). A computer program recorded on a recording 
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medium can also be executed directly by the computer. 

As used in this specification, "computer" includes hardware and an 
operating system, with the hardware being operated under the control of the 
operating system. If the hardware is operated by an application program having 
5 no need of an operating system, then the hardware itself will constitute the 
computer. The hardware comprises at least a microprocessor like a CPU and 
means for reading a program recorded on a recording medium. For this purpose, 
the computer program includes program code for realizing the function of each 
of the means described in the foregoing. Some of the functions can be 

10 implemented by the operating system instead of an application program. 

The recording media in this invention include floppy disks, CD-ROM disks, 
opto-magnetic disks, IC cards, ROM cartridges, punched cards, bar codes and 
other such printed symbols, internal storage devices (including RAM and ROM) 
and external storage devices. 

15 Fig. 5(a)-(c) are diagrams for explaining the overlay operation of image 

data stored in the frame memory 22 and embelUshment effect bitmap data BMDl 
stored in the embelUshment effect bitmap memory 26. Fig. 5 (a) shows the 
memory space of the frame memory 22, containing text image data. Fig. 5 (b) 
shows the memory space of the embelUshment effect bitmap memory 26, 

20 containing embellishment effect bitmap data BMDl (a rectangular figure) and 
coordinate data PD showing the position and extent of the overlay. The (xl, yl), 
(x2, y2) of the coordinate data PD in Fig. 5 (b) correspond to the coordinates (xl, 
yl), (x2, y2) of Fig. 5 (a). Fig. 5 (c) shows the embeUished image data DDVl 
consisting of the original image data overlaid with the embelUshment effect 

2 5 bitmap data BMDl. 
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The overlaying of the image data and embelHshment effect bitmap data 
BMDl is effected based on the coordinate data PD. In the embellishment overlay 
circuit 12, the stream of image data is input to the first multipUer 40, while the 
second multiplier 42 receives only the embelUshment effect bitmap data BMDl 
5 for the portion defined by the coordinates (xl, yl) and (x2, y2), which is the 
overlay portion. The timing of the input of the embelHshment effect bitmap data 
BMDl to the multiplier 42 is controlled by the CPU 20 based on the coordinate 
data PD. Simultaneously with the input of the embellishment effect bitmap data 
BMDl to the multiplier 42, the coefficients kl and k2 of the multipliers 40 and 

10 42 are modified. When the embellishment effect bitmap data BMDl is not being 
input to the multiplier 42, kl and k2 are set to (1, 0). When the embellishment 
effect bitmap data BMDl is being input to the multiplier 42, kl and k2 are set to 
(0, 1). As a result, with respect to pixels not in the area defined by the coordinate 
data (xl, yl) and (x2, y2), the original image data (text) shown in Fig. 5 (a) is 

15 output by the embellishment overlay circuit 12, while with respect to the pixels 
within the range defined by the coordinates (xl, yl), (x2, y2), the embellishment 
effect bitmap data BMDl shown in Fig. 5 (b) is output by the embellishment 
overlay circuit 12. In this way, the embelHshment effect bitmap data BMDl is 
superimposed on the original image data, forming the embelHshed image data 

20 DDVl representing the embeUishment image shown in Fig. 5 (c). 

The embeUishment images can be expanded in the embelHshment effect 
bitmap memory 26 to correspond with the overlay position within the image data. 
Fig. 6 is a diagram for explaining the embelHshment effect bitmap data BMDl 
expanded in the embelHshment effect bitmap memory 26. A portion of the 

25 embelHshment effect bitmap memory 26 corresponding to one frame of image 
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data is allocated for expanding the embellishment image, which is expanded at 
the location defined by the coordinates (xl, yl), (x2, y2). When the expansion 
takes place as shown in Fig. 6, pixel data of the image data and embellishment 
effect bitmap data BMDl corresponding to the same position in the image are 
5 input simultaneously to the respective multipliers 40 and 42. At this time, for 
areas outside the area defined by the coordinate data PD coordinates (xl, yl) and 
(x2, y2), the coefficients (kl, k2) are set to (1, 0), while inside the range of the 
coordinates (xl, yl) and (x2, y2), coefficients (kl, k2) are set to (0, 1). In this way, 
the original image data can be overlaid with the embellishment effect bitmap 

10 data BMDl, producing the embellished image data DDVl representing the 
embelHshment image of Fig. 5 (c). 

Thus, when the embellishment image is expanded as shown in Fig. 6, 
enough memory capacity for one frame is required for the embellishment effect 
bitmap data BMDl. However, if the embellishment image is expanded as shown 

15 in Fig. 5 (b), it is only necessary to have enough memory space to accommodate 
the size of the expanded embellishment effect bitmap data, meaning it is possible 
to get by with a smaller memory capacity. 

Fig. 7(a)-(c) are diagrams for explaining examples of displays on a 
projection screen 104 of original images input from a personal computer that 

2 0 have been overlaid with embellishment images. Fig. 7 (a) shows a bar graph as 
the original image, embelhshed with a pointing finger image. Fig. 7 (b) shows a 
flow chart embellished with check marks, and Fig. 7 (c) shows text with a 
horizontal fine superimposed. 

Fig. 8(a)-(c) are another diagrams for explaining the displays on a 

2 5 projection screen 104 of original images input from a personal computer that 
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have been overlaid with embellishment images. Fig. 8 (a) shows text overlaid 
with a marker. Fig. 8 (b) shows a picture of an airplane overlaid with an oval. 
Fig. 8 (c) shows a letter A overlaid with a rectangle. 

The coordinate data PD includes only two point coordinates showing the 
5 overlay position and extent of the embellishment image. To use the type of 
overlay shown in Figs. 7 (a) and 7 (b), and Fig. 8 (b), the part of the area defined 
by the two point coordinates where there is no embellishment figure is processed 
so that no overlay is effected there. 

Fig. 9 is a diagram for explaining the embelhshment effect bitmap memory 

10 26 when the embellishment images of Fig. 7 (b) are being expanded. Only the 
part of the embellishment effect bitmap data BMDl that forms the check mark 
is superimposed on the original image. The pixels that do not form that part of 
the overlay are comprised of designated pixel data. For example, all the bits of 
the RGB pixel data could be expanded as Os. The embellishment effect bitmap 

15 data BMDl could be input to the coefficient setting section 46 and the data 
examined to determine whether there are pixels where there are no 
embellishment figures. When there are such pixels, the coefficients (kl, k2) 
applied to the multipliers 40 and 42 can be adjusted to (1, 0). Doing this enables 
just the figure part of the embellishment effect bitmap data to be superimposed 

2 0 on the original image. The coordinate data PD can of course be comprised of 
multiple point coordinates around the portion with the embellishment figure, in 
which case it would only be necessary to use the coordinate data PD to overlay 
just the embellishment figure portion. 

The embellishment images (a pointer, a horizontal line or the like) shown 

25 in Fig. 7(a)-(c) are superimposed at specified locations within the projection 
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images. Here, the coordinate data PD comprises coordinates (xl, yl) that 
indicate the specified position and coordinates (x2, y2) that determine the size of 
each preset embeUishment image. The embellishment images (a marker, a oval, 
a rectangle or the like) shown in Fig. 8(a)-(c) are superimposed by specifying the 
5 overlay position and extent within the projection images. In this case, the 
coordinate data PD comprises the preset coordinates (xl, yl) and the coordinates 
(x2, y2) corresponding to the specified size. The embellishment images are not 
limited to those shown in Figs. 7(a)-(c) and 8(a)-(c) and any type of figure can be 
used as the embellishment images. If the embelhshment images used are the 

10 sort shown in Fig. 8(a)-(c), a drawing program could be used to create the bitmap 
data instead of pre-storing the embellishment images in the embellishment effect 
memory 24. Thus, the remote controller 29 could be used to overlay the 
embellishment by writing the bitmap data of the figure thus drawn into the 
embellishment effect bitmap memory 26. Thus, the embellishment images used 

15 to overlay the image data are not limited to the images stored in the 
embelhshment effect memory 24. Moreover, using the drawing program also 
enables a user to use the remote controller 29 to create embellishment images of 
any desired shape such as free-form curve for overlay purposes. 

Also, since the embellishment effect bitmap data BMDl includes the 

20 coordinate data PD indicating the overlay position, an embellishment image can 
be displayed at any point that is specified with the remote controller 29. The 
embelhshment effect bitmap data BMDl and the coordinate data PD are being 
constantly updated in sync with the sync signal RSYNC, so the remote controller 
29 can be used to move an embeUishment image to any point within the 

25 projection image, on a realtime basis. Moreover, multiple embeUishment images 
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of any type can be displayed, as shown in Fig. 7 (b), and the images fixed in 
position. A command issued by the remote controller 29 and received by the 
remote control section 28 can be used to execute the program in the 
embellishment effect memory 24 to generate the embellishment effect bitmap 
5 data BMDl. 

In the examples shown in Figs. 7(a)-(c) and 8(a)-(c), the embelhshment 
images appear to be blocked in on the original image. The overlay effect can be 
obtained by substituting the embellishment effect bitmap data for part of the 
original image data. In the embellishment overlay circuit 12 (Fig. 4), the 

10 coefficients (kl, k2) are set at (1, 0) for those portions where no embellishment 
is added, while the coefficients (kl, k2) are set at (0, 1) for portions where an 
embellishment is added. 

Transparent embelhshments can be added by modifying kl and k2. 
Setting both kl and k2 to 1/2, for example, would provide this transparent effect. 

15 Fig. 10(a) and 10(b) are diagrams for explaining projected images overlaid 

with transparent embellishments. Fig. 10 (a) is a projection image showing the 
embellishment of Fig. 7 (c) used as a transparent overlay. Similarly, Fig. 10 (b) 
is a projection image showing the embellishment of Fig. 8 (c) used as a 
transparent overlay. These show how transparent embelhshments can be 

20 achieved by setting the coefBcients kl, k2 of the multipliers 40 and 42 in the 
circuit 12 (Fig. 4) to 1/2. 

The embellishment effects shown in Figs. 7(a)-(c), 8(a)-(c) and 10(a)-(b) 
were obtained using kl, k2 set at a fixed 0, 1 and 1/2. However, kl and k2 values 
can be used that change with time. For example, for portions where an 

25 embelhshment effect is added, the coefficients (kl, k2) can start offset at (0, 1) 
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and, as time passes, can be gradually changed thus: (0.1, 0.9), (0.2, 0.8) ... (1, 0). 
As a result, the embellishment would start out looking solid, then would 
gradually become transparent, and would end up disappearing. By changing the 
coefficients kl and k2, such embelUshment effects can be obtained. The 
5 modification of the coefficients is effected by the coefficient setting section 46 
based on commands fi:om the CPU 20. 

When part of the image is displayed enlarged, the display position can be 
modified along with the modification of the part that is enlarged. 

Fig. ll(a)-(c) are diagrams for explaining the positioning of embellishment 

10 images when part of the image is enlarged. Fig. 11 (a) is a projection image 
showing one frame of the original image (letters of the alphabet) overlaid with a 
square embellishment image. In Fig. 11 (a), the embellishment square is in the 
center of the image, covering the letter M. Fig. 11 (b) is an enlargement of the 
portion in Fig. 11 (a) defined by the dashed line. As shown, the embellishment 

15 overlays the letter M. Fig. 11 (c) is an enlargement of the portion of Fig. 11 (a) 
defined by the dot-dash line. As shown in Fig. 11 (c), even when the part 
displayed enlarged is changed, the embellishment still overlays the letter M 
position. 

When the type of image enlargement shown in Figs. 11 (b) and 11 (c) is 
20 used, only the pixels of the enlarged portion are read out of the frame memory 22 
and embellishment effect bitmap memory 26. In the case of Fig. 11 (b), for 
example, just the original image data of the portion shown within the dashed line 
in Fig. 11 (a) is read out of the frame memory 22 and input to the multiplier 40. 
When reading out the pixel data corresponding to the portion of the original 
25 image within the area defined by the coordinates (xl, yl), (x2, y2), the pixel data 
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corresponding to the embellishment effect bitmap data BMDl is read out of the 
embelUshment effect bitmap memory 26 and input to the multiplier 42. With 
respect to portions outside the area defined by the coordinates (xl, yl), (x2, y2), 
the coefficients (kl, k2) of the multipliers 40 and 42 are set at (1, 0), and at (0, 1) 
5 for areas within the said coordinates. The part to be enlarged can be specified 
using the remote controller. In this way, an image can be obtained comprising 
an embellishment image superimposed on a specified part of the original image. 

The enlargement within the specified area by controlling the readout of 
enlargement portion pixels in accordance with the enlargement factor. 
10 Specifically, an enlarged image of the specified portion can be obtained by 
reading out the pixels of all or part of the enlargement portion multiple times. 

Even when the enlargement portion changes, as in Fig. 11 (c), the enlarged 
image can be obtained by reading out the pixels of the area within the dot-dash 
line. 

15 As described, an enlarged image can be displayed by overlaying the 

original image within the specified area with an embellishment image based on 
the coordinate data PD, so the overlay position of the embellishment can be 
modified as the enlarged portion that is to be displayed is changed. 

The embellishment overlay circuit 12, embellishment effect bitmap 

2 0 memory 26 and frame memory 22 correspond to the image embellishment section 
and image overlay section in the first projection display apparatus of this 
invention. 

B. Second embodiment: 
2 5 Fig. 12 is a block diagram for schematically illustrating the general 
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configuration of a projection display apparatus that is a second embodiment of 
this invention. The projection display apparatus includes a video signal 
conversion circuit 60, a liquid crystal display driver circuit 14, a liquid crystal 
display panel 16, a frame memory 22, an embellishment effect memory 24, a 
5 remote control section 28, a CPU 20, an illumination optical system 100 and a 
projection optical system 102. The video signal conversion circuit 60, 
embellishment effect memory 24, remote control section 28 and CPU 20 are 
connected to each other via a bus 1. The Uquid crystal display driver circuit 14 
is also connected to the bus 1, but the connection is not shown in Fig. 12. 

10 The projection display apparatus of this second embodiment does not have 

the embellishment overlay circuit 12 or the embellishment effect bitmap memory 
26 possessed by the first embodiment (Fig. 1). The video signal conversion circuit 
60 is used to overlay embellishment images on the original image. 
Embellishment effect bitmap data is stored in the embellishment effect memory 

15 24. Thus, the video signal conversion circuit 60, frame memory 22 and 
embellishment effect memory 24 correspond to the image embellishment section 
and image overlay section in the first projection display apparatus of this 
invention. 

Fig. 13 is a block diagram for schematically illustrating the configuration 
20 of the video signal conversion circuit 60. The video signal conversion circuit 60 
includes a sync separator 30, an A-D conversion section 32 and a video processor 
62. The sync separator 30 and A-D conversion section 32 have the same 
functions as in the first embodiment, so further explanation thereof is omitted. 
The video processor 62 is a microprocessor that performs overlay 
2 5 processing of the original image data and embellishment effect bitmap data, and 
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controls the input and output of image data to and from the frame memory 22. 

The image data DVl output by the A-D conversion section 32 and the 
embelhshment effect bitmap data BMDl expanded in the embellishment effect 
memory 24 are input to the video processor 62, which uses this input to generate 
5 embellished image data and writes the data into the frame memory 22. 

The writing of the embelUshed image data to the frame memory 22 is 
synchronized by the sync signal WSYNC. The readout of the embellished image 
data from the frame memory 22 is synchronized by a sync signal RSYNC output 
by the liquid crystal display driver circuit 14 (Fig. 12). The sync signals WSYNC 

10 and RSYNC are not mutually synchronized, although it is also possible to use 
sync signals WSYNC and RSYNC that are synchronized. 

The video processor 62 includes a write control signal generator and a read 
control signal generator (not shown). When the embellished image data is to be 
written to or read from the frame memory 22, the signal generators generate 

15 addresses and control signals that are supplied to the frame memory 22. The 

embellished image data is written to the frame memory 22 in accordance with the 
address and control signals generated by the write control signal generator, and 
the data is read out of the frame memory 22 in accordance with the address and 
control signals generated by the read control signal generator. Sync signal 

2 0 WSYNC or RSYNC is used when generating the addresses and the control 
signals. 

In the video processor 62 the embeUished image data is produced by 
selecting the image data DVl and the embelhshment effect bitmap data BMDl 
and the data is written into the frame memory 22. A data selector in the video 
2 5 processor 62 is used to select the image data DVl and embelhshment effect 
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bitmap data BMDl. 

Fig. 14 is a diagram for explaining the data selector 64 of the video 
processor 62. A data selector 64 is provided for each of the RGB colors. Image 
data DVl and embellishment effect bitmap data BMDl are input to the data 
5 selector 64, along with a selection signal SEL. The selection of the image data 
DVl and embellishment effect bitmap data BMDl is done on a pixel data by pixel 
data basis and controlled by the selection signal SEL. Thus, under the control of 
the selection signal SEL, the data selector 64 selects either image data DVl pixel 
data or embellishment effect bitmap data BMDl pixel data and writes the data 

10 into the frame memory 22. Therefore, the data written into the frame memory 
22 becomes the embellished image data of the original image overlaid with the 
embellishment image. The selection signal SEL is generated by the CPU 20 
based on the coordinate data PD. 

In this embodiment the embellishment images appear to be blocked in on 

15 the original image. This corresponds to when in the first embodiment the 
coefficients (kl, k2) of the multipliers 40 and 42 are set at (0, 1) with respect to 
the embellishment image overlay portion. 

When embellishment effect bitmap data BMDl is expanded as shown in 
Fig. 5 (b), only the embellishment effect bitmap data BMDl for the area defined 

2 0 by the coordinate data PD coordinates (xl, yl) and (x2, y2) is input to the data 
selector 64. The timing of the input of the embellishment effect bitmap data 
BMDl to the data selector 64 is controlled by the CPU 20 based on the sync 
signal WSYNC and the coordinate data PD. Specifically, the timing of the input 
of the embellishment effect bitmap data BMDl is determined by using coordinate 

2 5 data PD of the embellishment effect bitmap data BMDl to obtain the input 
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timing of the pixel data of the image data DVl for the overlay position. 
Simultaneously with the input of the embellishment effect bitmap data BMDl, 
the embellishment effect bitmap data BMDl is selected by the selection signal 
SEL. In this way, a selection between image data DVl and embellishment effect 
bitmap data BMDl can be made with respect to each pixel assigned to the same 
position in the image. 

When the embellishment effect bitmap data BMDl is expanded as shown 
in Fig. 6, pixel data of the image data DVl and embellishment effect bitmap data 
BMDl corresponding to the same position in the image are input simultaneously 
to the data selector 64. The input pixel data is specified based on the sync signal 
WSYNC. Thus, pixel data can be assigned to the same position in the original 
image by synchronizing the readout of the embellishment effect bitmap data 
BMDl from the embellishment effect memory 24 with the input of the image data 
DVl to the video processor 62. Also, the embellishment image can be 
superimposed on the original image by using the coordinate data PD as a basis 
for supplying the selection signal SEL to the data selector 64. 

In this embodiment the embelhshed image data can be obtained by writing 
directly to the frame memory 22. The embelhshed image data written to the 
frame memory 22 is read out by the video processor 62. 

Embelhshed image data DDV2 output by the video signal conversion 
circuit 60 is supplied to the liquid crystal display driver circuit 14 (Fig. 12). The 
liquid crystal display driver circuit 14 displays on the liquid crystal display panel 
16 the image with the embelhshment overlay corresponding to the embelhshed 
image data DDV2. The image displayed on the hquid crystal display panel 16 is 
projected onto the projection screen 104 by the optical system 100 and 102. 
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In the first and second embodiments described in the foregoing, 
embeUishment images can be superimposed on an original image within the 
projection display apparatus. This means it is possible to overlay an 
embellishment image on an image signal output by a personal computer, video 
5 recorder or TV. Moreover, by using the coordinate data PD, an embelUshment 
image can be superimposed at any desired location within the image data, and 
the embellishment images can be enlarged or reduced. 

C. Third embodiment: 

10 C-1. Configuration and operation of the projection display apparatus: 

Fig. 15 is a block diagram for schematically illustrating the general 
configuration of a projection display apparatus that is a third embodiment of this 
invention. The projection display apparatus includes a video signal conversion 
circuit 210, an embellishment overlay circuit 212, a liquid crystal light valve 

15 driver circuit 214, a liquid crystal hght valve 216, a frame memory 222, an 
embellishment image storage memory 224, an embellishment image expansion 
memory 226, an embellishment image drawing memory 227, a remote control 
section 28, a CPU 20, an illumination optical system 100 and a projection optical 
system 102. The video signal conversion circuit 210, embelUshment overlay 

20 circuit 212, embelUshment image storage memory 224, remote control section 28 
and CPU 20 are connected to each other via a bus 1. The embelUshment image 
expansion memory 226 and embeUishment image drawing memory 227 are also 
connected to the bus 1, but this is not shown in Fig. 15. The Uquid crystal Ught 
valve 216 is uniformly iUuminated by the iUumination optical system 100, and 

25 images formed by the Uquid crystal Ught valve 216 are projected onto the 
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projection screen 104 by the projection optical system 102. Fig. 15 depicts the 

optical systems 100 and 102 in a simpUfied fashion. 

The video signal conversion circuit 210 is used to perform analog-digital 

conversion of input analog video signals AVI, write the converted image data into 
5 the frame memory 222 and retrieve image data from the frame memory 222. The 

analog video signal AVI can be an RGB signal Si carrying a computer screen 

image, or a composite image signal S2 from a video recorder, TV or the like. 

Fig. 16 is a block diagram for schematically illustrating the configuration 

of the video signal conversion circuit 210. The video signal conversion circuit 210 
10 includes a sync separator 230, an A-D conversion section 232 and a video 

processor 234. The functions of the sync separator 230, A-D conversion section 

232 and video processor 234 are substantially the same as those of the parts 30, 

32 and 34 shown in Fig. 2, so further explanation thereof is omitted. 

The embellishment image storage memory 224 is used to store 
15 embelHshnient image data representing the specific type of embellishment image 

that is to be superimposed on an input image, referred to as a original images. 

Multiple types of embelUshment image data (stored data) are stored in a 

predetermined format in the embelHshment image storage memory 224, which 

also holds a program to expand the stored data in a bitmap data format. The 
20 data in the memory 224 represents images having a prescribed shape or color 

determined beforehand, referred to below as prescribed images. 

The embellishment image expansion memory 226 is used to store the 

overlay embellishment images as bitmap data, which are expanded by the 

program in the memory 224. 
25 The embellishment image drawing memory 227 has the same structure as 



36 



a frame memory, and is used to store embellishment images drawn by the CPU 
20. 

The embellishment overlay circuit 212 is for overlaying an original image 
with embellishment images from memory 226 or memory 227. 
5 The embellished image data DDVl output by the embelUshment overlay 

circuit 212 is supplied to the liquid crystal light valve driver circuit 214 (Fig. 15). 
The embelHshed image data DDVl represents the image overlaid with 
embellishment images from the embellishment image expansion memory 226 or 
embellishment image drawing memory 227. Based on the embellished image 

10 data DDVl, the liquid crystal light valve driver circuit 214 modulates the 
illumination light of the illumination optical system 100, via the hquid crystal 
light valve 216. The light thus modulated is projected onto the projection screen 
104 by the projection optical system 102, thereby displaying the embellished 
image. This liquid crystal light valve 216 corresponds to the electro-optical 

1 5 device used in the second projection display apparatus of this invention, and the 
liquid crystal light valve driver circuit 214 corresponds to the image display 
signal generator. Here, the term projection optical system is used in a broad 
sense that also encompasses the illumination optical system. 

The embellished image data DDVl output by the circuit 212 can be 

2 0 enlarged or reduced by an enlarging/reducing circuit (not shown) provided 
between the circuits 212 and 214. 

The projection display apparatus is controlled by the remote control 
section 28 in accordance with commands from the remote controller 29. What the 
remote control section 28 controls is mainly processing related to embellishment 

2 5 images. In accordance with commands received from the remote controller 29, 
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this includes selecting the type of embellishment image and controlling the 
overlay position and size of embellishment images, and whether embellishment 
images are displayed or not. 

The functions of the video signal conversion circuit 210, embellishment 
5 overlay circuit 212 and remote control section 28 can be implemented by a 
computer program instead of in hardware. 

C-2. Configuration and operation of embellishment overlay circuit: 

Fig. 17 is a block diagram for schematically illustrating the configuration 

10 of the embellishment overlay circuit 212. The embellishment overlay circuit 212 
includes an overlay processing section 240, two write/read control sections 250 
and 260, and a menu display controller 290. The menu display controller 290 
superimposes menu screen data on the image data SDV3 output by the overlay 
processing section 240, and outputs image data DDVl with the superimposed 

15 menu screen. That is, the menu display controller 290 is controlled by remote 
control section 28 when the user selects images and settings by using the remote 
controller 29 and displays a menu according to commands. 

The first write/read control section 250 is used to read stored data CPD 
from the embelUshment image storage memory 224 and write the data to the 

2 0 embelUshment image expansion memory 226, and to read out data stored in the 
memory 226. The second write/read control section 260 is used to write 
embelUshment images drawn by the CPU 20 to the embeUishment image 
drawing memory 227, and to read out images stored in the memory 227. 

Fig. 18(a) and 18(b) are diagrams for explaining the embelUshment image 

25 expansion memory 226 and an embelUshment image drawing memory 227. Fig. 
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18 (a) shows the memory space of the memory 226. 

The memory 226 is used to store the data of prescribed images expanded 
by the program in the embelUshment image storage memory 224. This expansion 
image data includes image information ID, prescribed image bitmap data SBMD, 
5 display magnification data MD and coordinate data PD. The image information 
ID shows the width, height and other such image attributes. Prescribed image 
bitmap data SBMD denotes the pixel data of the expanded prescribed image, in 
this case the arrow cursor. The data SBMD includes overlay image data SBMDa 
and background image data SBMDb, The display magnification data MD shows 

1 0 the vertical and horizontal magnification factors. The coordinate data PD shows 
the coordinates (xl, yl) indicating where on the original image the embellishment 
image represented by the prescribed image bitmap data SBMD is to be 
superimposed. The header of the image data SBMD (the starting or base position 
of the prescribed image, at the upper left) is associated with the position of 

15 coordinates (xl, yl). The image information ID is expanded starting from 
address 0X00 in memory 226. Image data SBMD is expanded starting from 
address 0X10. Display magnification data MD is stored starting from address 
0X30. Coordinate data PD is stored starting from address 0X32. Here, X is an 
arbitrary value fi:om hexadecimal 0 to F. 

20 When the image data SBMD is read out of the embellishment image 

expansion memory 226, in accordance with the display magnification data MD 
it is enlarged in the embellishment overlay circuit 212 to a similar figure and 
superimposed on the original image. The enlargement is effected by controlHng 
the read clock in the write/read control section 250. For example, a x2 

2 5 enlargement vertically and horizontally, meaning a display magnification of 
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200% that quadruples the image area, can be achieved by reading out pixel data 
using a pixel clock frequency that is half the frequency used when no 
magnification is used, thereby reading out the data for each pixel twice in each 
direction, doubling the size of the image display. Similarly, a display 
5 magnification of 400% can be achieved by running the pixel clock at 1/4 frequency. 
Thus, a magnification of 2^ in each direction can be achieved by running the 
pixel clock at a frequency 1/2". A dedicated processing circuit can be provided to 
effect enlargements by any desired factor. 

The user can use an embellishment image display key on the remote 

10 controller 29 associated with a particular embellishment image to have the 
embellishment image data concerned expanded in the embelUshment image 
expansion memory 226. The remote controller 29 can be used to display menu 
screens to use for associating a particular embellishment image with a specific 
key. The remote controller 29 can also be used to specify a display magnification 

15 data MD which is allowed to be set. 

Fig. 19 is a diagram for explaining a menu screen displayed by a user 
operating a remote controller 29. The example shown is one in which the user 
has operated the remote controller 29 to display the menu, selected Effects 
(embellishment condition setting mode), and selected Effect 1 (pointer image) 

2 0 among a plurality of Effects. The select key on the remote controller 29 can be 
used to select one of the five pointers shown, and it is also possible to select one 
of the three display magnification ratios shown. The display magnification data 
MD can be set at prescribed values which are included in the stored data and 
expanded in the memory 226. The embelUshment image display key can be used 

2 5 to set the pointer shape and/or magnification from the menus each time. The 
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menu screen of Fig. 19 is just an example, and is not limited to the image shapes 
and magnifications shown. Instead, a larger selection of image shapes can be 
provided, and the display magnification can be set at any factor desired. 

The coordinate data PD can be obtained by using a pointing device 
5 attached to the remote controller 29 specify the position of the overlay within the 
original image data. Instead, the embellishment image data can be stored in the 
memory 224 from a floppy disk or other such recording media, and selected using 
the remote controller 29. A communication line can also be used to store the data 
in the memory 224. Prescribed images can also be extracted from display images 

10 stored in the frame memory 222, and placed in the memory 224. 

Fig. 18 (b) shows the memory space in the embellishment image drawing 
memory 227. The embellishment image drawing memory 227 has the same 
structure as the frame memory described above. The memory 227 includes three 
storage areas, one for each of the RGB colors. The width of the storage for each 

15 pixel corresponds to the data width of one pixel. Drawn image bitmap data 
DBMD drawn by the CPU 20 is stored in the memory 227. The drawn image 
bitmap data DBMD includes draw data DBMDa drawn by the CPU 20, and 
background image data DBMDb. 

The embellishment image drawing memory 227 has (1/4)^ the capacity of 

2 0 the frame memory 222. When the drawn image bitmap data DBMD drawn by 
the CPU 20 is read out of the memory 227, it is enlarged by a factor of 4^ and 
superimposed using the same number of pixels as the original image. As 
described in the foregoing, the readout is done using a 1/4 frequency pixel clock. 
The embelUshment image drawing memory 227 does not have to have (1/4)^ the 

25 capacity of the frame memory 222, and can instead have (1/2)^, (1/3)^ ... the 
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capacity. Or, it can have the same capacity as the frame memory 222. Thus, if 
the capacity of the frame memory 222 is M x N pixels, the memory 227 only needs 
to have a capacity of (M/n) x (N/n) pixels (where n is an integer of 1 or more). If 
the memory 227 has 1/n^ the capacity of the frame memory 222, embellishment 
5 images drawn by the CPU 20 are reduced 1/n^-fold for storage in the memory 227. 
The size and cost of the apparatus can be reduced by using a memory 227 that 
is smaller than the frame memory 222. Ideally, n is preferable to 2m^ (where m 
is an integer). If the memory 227 is given a capacity that is \I2^^ (where m is an 
integer) the capacity of the frame memory 222, it is possible to readily enlarge the 

10 embellishment image by a factor of 2^°" simply by setting the pixel clock to 1/2°" 
the frequency when reading out the embellishment image data from the memory 
227. In such cases, a dedicated processing circuit is not needed. 

The overlay processing section 240 includes four multipliers 270, 272, 276 
and 278, two adders 274 and 280, and a coefficient setting section 282. There is 

15 an overlay processing section 240 for each of the colors RGB. 

The multipliers 270, 272, 276 and 278 are used to multiply image pixel 
data by a fixed factor. 

The coefficient setting section 282 is used to set coefficients kl, k2, k3, k4 
for the respective multipUer 270, 272, 276, 278. The coefficients can be set to a 

2 0 value from 0 to 1, and generally are set so that the sum of (kl-k3), (k2-k3), k4 is 
1. 

Original image data DV2 from the video processor 234 (Fig. 16) is input to 
the first multipUer 270, and embellishment image data DBMD from the 
embeUishment image drawing memory 227 is input to the second multiplier 272. 
25 EmbelHshment image data SBMD retrieved from the embellishment image 
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expansion memory 226 is input to the forth multiplier 278. In the first multipUer 
270, the original image data DV2 is multiplied by kl. In the second multiplier 
272 the first embellishment image data DBMD (drawn image bitmap data) is 
multiplied by k2. In the forth multiplier 278, the second embellishment image 
5 data SBMD (prescribed image bitmap data) is multiplied by k4. Original image 
data DV3 output by the first multiplier 270 and first embellishment image data 
DBMDl output by the second multiplier 272 are added by the adder 274 and 
output as overlay image data SDVl to the third multiplier 276 where the data is 
multiplied by k3. Overlay image data SDV2 output by the third multipHer 276 

10 and second embellishment image data SBMD2 output by the forth multiplier 278 
are added by adder 280. As a result, embellished image data SDV3 output by the 
adder 280 is original image data DV2 overlaid with first embellishment image 
data DBMD and second embellishment image data SBMD. 

Fig. 20(a)-(c) are diagrams for explaining overlay image data SDVl formed 

15 by overlaying image data DV2 with first embellishment image data DBMD 
(drawn image bitmap data). The overlay image data SDVl of Fig. 20 (c) was 
produced by effecting a pixel by pixel overlay of the original image data DV2 of 
Fig. 20 (a) by the first embellishment image data DBMD of Fig. 20(b). By setting 
coefficients kl, k2 at (0.5, 0.5), the rectangle of the draw data DBMDa as the 

2 0 first embellishment image data superimposed on the original image data DV2 
becomes semitransparent, so the row of letters KLMNO is visible. By setting kl, 
k2 (Fig. 17) to (0, 1), the rectangle of the draw data DBMDa can be made opaque, 
so the row of letters KLMNO cannot be seen. Whether the first embellishment 
image data is semitransparent or opaque is set when the first embellishment 

25 image data DBMD is drawn by the CPU 20 and stored in the embeUishment 
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image drawing memory 227. 

When the part of the embellishment image data DBMD that is being read 
out of the embellishment image drawing memory 227 is the background image 
data DBMDb, it is better not to superimpose the background image data DBMDb 
5 on the original image data DV2. Therefore, transparent image data having a 
designated value is stored in the background image data DBMDb portion. The 
coefficients kl, k2 can be set to (1, 0) when this designated transparent image 
data is being read out, so the image data is not used as overlay. The coefficients 
kl, k2 can be set to (0.5, 0.5) to use the background image data DBMDb as a 
10 semitransparent image. The first embelUshment image data DBMD pixel data 
can be provided with flags to set whether or not the image data is to be used as 
overlay. 

Fig. 21(a)-(c) are diagrams for explaining the embelUshed image data 
SDV3 formed by the overlay image data SDVl overlaid by the second 

15 embellishment image data (prescribed image bitmap data) SBMD. The 
embellished image data SDV3 of Fig. 21 (c) was produced by overlaying the 
overlay image data SDVl of Fig. 21 (a) with the second embellishment image 
data SBMD of Fig. 21 (b) at a display magnification of 100%, using as the base 
point a position defined by the coordinates (xl, yl). The overlaying of the second 

2 0 embelUshment image data (prescribed image bitmap data) SBMD is implemented 
based on the image information ID, display magnification data MD and 
coordinate data PD. In the embellishment overlay circuit 212 (Fig. 17), the 
original image data DV2 and the first embelUshment image data DBMD stream 
into the multipUers 270 and 272. In the case of the forth multipher 278, the 

25 prescribed image bitmap data SBMD is input only into the area comprising the 
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overlay portion, defined by the coordinates (xl, yl), the width and height of the 
prescribed image bitmap data SBMD (which is information stored in the image 
data ID) and the display magnification data MD. The timing of the input of the 
data SBMD to the forth multiplier 278 is controlled by the write/read control 
5 section 250 in accordance with the coordinates (xl, yl), the width and height of 
the prescribed image bitmap data SBMD and the display magnification data MD. 

If the coefficients k3, k4 (Fig. 17) are set to (0, 1), the second 
embellishment image data SBMD will be superimposed on the overlay image 
data SDVl as an opaque image that does not allow the overlay image data SDVl 
10 to show through. The overlay image data SDVl can be seen if k3, k4 are set at 
(0.5, 0.5). 

When the part of the second embellishment image data SBMD that is 
being read out of the embellishment image expansion memory 226 is the 
background image data SBMDb, it is better not to superimpose this background 

15 image data SBMDb on the overlay image data SDVl. Therefore transparent 
image data having a designated value is stored in the background image data 
SBMDb portion. The coefficient k3, k4 can be set to (1, 0) when this designated 
transparent image data is being read out so that it is not used as overlay. The 
coefficient kS, k4 can be set to (0.5, 0.5) to use the background image data 

20 SBMDb as a semitransparent image. The second embellishment image pixel 

data can be provided with flags to set whether or not the image data is to be used 
as overlay. 

The coefficient setting section 282 can examine the embellishment image 
data SBMD and DBMD and set the coefficients kl to k4, in accordance with the 
25 conditions, on a pixel by pixel basis. The coefficient values mentioned above are 
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just examples; the coefficients can be set at any value from 0 to 1, depending on 
the conditions of use. 

When the coefficients are set to 1 or 0, for an opaque overlay image, the 
overlay processing section 240 does not have to be comprised of the multipUers 
5 270, 272, 276 and 278 and the adders, but can instead be configured as a selector 
that selects the original image, or the first embelhshment image, or the second 
embellishment image, on a pixel by pixel basis. 

As described in the foregoing, the embellishment overlay circuit 212 can 
overlay original image data DV2 output by the video processor 234 with fi^rst 

10 embellishment image data (drawn image bitmap data) DBMD read from the 
embellishment image drawing memory 227 and second embelhshment image 
data (prescribed image bitmap data) SBMD read from the embelhshment image 
expansion memory 226. It can also overlay menu screen data. This means that 
it is possible to overlay images received from a computer or the like with various 

15 types of embelhshment images, as explained below. 

Figs. 22(a)-(c) are diagrams for explaining examples of displays on the 
projection screen 104 of images input from a personal computer that have been 
overlaid with embelhshment images of a specifi.c shape stored in the 
embelhshment image storage memory 224. Fig. 22 (a) shows a pointer (arrow 

20 figure) superimposed on the original image, a chart; Fig. 22 (b) shows a different 
pointer (pointing figure) superimposed on a bar graph; and Fig. 22 (c) shows 
another pointer (check figure), superimposed on a flow chart. Images having a 
prescribed shape (prescribed image) such as these pointers can be read out of the 
embelhshment image storage memory 224 and placed in the embelhshment 

25 image expansion memory 226 for superimposing on the original image. 
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As shown in Fig. 18 (a), the embellishment image data stored in the 
memory 226 includes coordinate data PD denoting the overlay position for the 
prescribed image bitmap data SBMD. A pointing device on the remote controller 
29 can be used to change this position. as desired. The display on the screen 104 
5 is constantly being refreshed in sync with the sync signal RSYNC, so the 
embellishment image (pointer) can be moved anywhere on the screen on a 
realtime basis. Each of the examples shown in Fig. 22(a), (b) and (c) depict a 
single pointer, but multiple pointers can be used by storing the necessary data 
for the multiple pointers in the memory 226. 

10 Fig. 23(a)-(c) are diagrams for explaining examples of displays on the 

projection screen 104 of images input from a personal computer that have been 
overlaid with embelUshment images drawn by the CPU 20. Fig. 23 (a) shows a 
square shape superimposed on the original image (text); in Fig. 23 (b) the 
embellishment overlays are lines of different widths; and in Fig. 23 (c) the 

15 embellishments are hne markers of different widths and orientations. 

Images such as these drawn by the CPU 20 are stored in the 
embellishment image drawing memory 227 in a state of equivalence with the 
display screen, to be used on original images. 

The embellishment image in Figs. 22(a)-(c) are shown as opaque images, 

20 but can be changed to semitransparent images by selecting semitransparent 
embellishments of the same shape. Conversely, in the case of Figs. 23(a)-(c) 
opaque embellishment images can be superimposed instead of the 
semitransparent ones shown, by selecting an opaque color and having the CPU 
20 redraw the image accordingly. 

25 Original images can be overlaid with various embeUishment images, such 
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as those described below, by using the second embellishment image data (drawn 
image bitmap data) stored in the embellishment image expansion memory 226 
and the first embellishment image data (prescribed image bitmap data) stored 
in the embelhshment image drawing memory 227. 

5 

C-3. Box images: 

Figs. 24(a)-(c), 25(a)-(c) and 26(a)-(c) are diagrams for explaining the 
process of overlaying an original image with square embellishment images. Fig. 
24 (a) shows embellishment image data stored in the memory 226; Fig. 24 (b) 

=1 10 shows the embellishment image data stored in the memory 227; and Fig. 24 (c) 

ij^ shows images displayed on the projection screen 104. 

y= To superimpose a square embellishment image on an original image, first 

£| the box image display function is called by pressing a key on the remote 

controller 29 that has been assigned for the operation beforehand. The square 
^15 embellishment image is a square image that has diagonal connecting two points 
^ on the display screen, referred to below as the box image. The box image 

conditions are set beforehand using menu screens such as those shown in Fig. 19. 
These menus are used with the remote controller 29, for example, to select the 
box color among multiple colors (blue, red, green, yellow, magenta, white, pink 
2 0 and so on), a semitransparent or opaque box image, the type of dot pattern used 
in the box image area, and so forth. Or, the system can be configured so that a 
menu is displayed each time the box image display key is pressed, to enable the 
image conditions such as color to be set according to a menu, and the conditions 
then stored in the embellishment image expansion memory 226. 
^25 When the box image display function is intended, the box coordinate 
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pointer BP image data for setting the two point coordinates that define the 
diagonal of the box image is read out of the embellishment image storage memory 
224 and placed in the embellishment image expansion memory 226 shown in Fig. 
24(a). The memory 224 contains multiple sets of image data of the box coordinate 
5 pointer BP corresponding to each of the image conditions such as color selected 
by using remote controller 29. 

When the box image display function is initiated, the selected image data 
is stored in the memory 226. The box coordinate pointer BP image data includes 
image information (upper left pointer information), prescribed image bitmap data 

10 (upper left image data), and coordinate data (display coordinates (xc, yc)). The 
box coordinate pointer BP image data is displayed on the projection screen 104, 
superimposed on the original image data stored in the frame memory 222, at a 
position CP given by the coordinates (xc, yc), as shown in Fig. 24 (c). As indicated 
by Fig. 24 (b), at this point there is nothing in memory 227. 

15 Using the above-described pointing device, the coordinates (xc, yc) of 

display position CP can be moved to any point desired as shown in Fig. 24(c). 
When the box coordinate pointer BP has been moved to the desired position, the 
coordinates (xl, yl) of a starting point SP on the diagonal of the box image are 
specified by pressing the enter button on the remote controller 29. 

20 When this is done, in addition to the box coordinate pointer BP, an image 

of a starting pointer BPS appears on the display at the specified starting point 
SP, as shown in Fig. 25 (c). For this, the image data for the starting pointer BPS 
and for the box coordinate pointer BP are read out of the embelUshment image 
storage memory 224 and into the embelUshment image expansion memory 226 

25 (Fig. 25 (a)). The pointing device is then used to move the box coordinate pointer 
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BP to the end point EP at the end of the box image diagonal opposite to the 
starting point SP, and the EP coordinates (x2, y2) are specified by pressing the 
enter button on the remote controller 29. In this way, the coordinates (xl, yl), 
(x2, y2) defining the starting and end points SP and EP along the diagonal of the 
5 box image are set, to be utilized when the CPU 20 draws the box image. Here too, 
the embellishment image drawing memory 227 contains nothing until the end 
point EP coordinates are specified. There is a starting point cancel key that 
enables the starting point setting to be cancelled. 

When the starting and end points have been specified by using remote 

10 controller 29, the data for a box image to be drawn by the CPU 20 to the same 

size as the rectangular area defined by the two point coordinates (xl, yl), (x2, y2), 
with the preset color and other image conditions, is stored in the memory 227 
(Fig. 26 (b)) and the image data of the starting pointer BPS in memory 226 is 
erased and disappears from the projection screen 104. Then, the box image in the 

15 memory 227 is superimposed on the original image data in the frame memory 
222 and the resulting image displayed on the projection screen 104, as shown in 
Fig. 26 (c). Multiple box images can be superimposed on an original image by 
repeating the above procedure the necessary number of times. The coefficients 
k3, k4 applied by the multipliers 276, 278 can be set at (1, 0) to have the display 

20 of the starting pointer BPS vanish from the screen while still retaining the 
pointer BPS image data in the memory 226. Alternatively, the starting pointer 
BPS can be removed from the screen by halting the readout of the image data 
fi-om the memory 226. 

Fig. 27(a)-(d) are diagrams for explaining the relationship between the 

25 position SP of a starting pointer BPS, and the position CP of box coordinate 
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pointer BP specifying the end point EP. The image of the starting pointer BPS 
changes based on the relationship between starting point SP and the position CP. 
If the point SP coordinates are (xl, yl) and the position CP coordinates are (xc, 
yc), the starting pointer BPS image will change as follows. 
5 When xc and yc are the same as or greater than xl and yl, upper left 

starting pointer BPSl (Fig. 27 (a)) will be selected and stored in the memory 226 
as the starting pointer BPS image. When xc is smaller than xl and yc is the 
same as or larger than yl, the upper right starting pointer BPS2 is selected and 
stored in the memory 226 as the starting pointer BPS image (Fig. 27 (b)). When 
10 xc and yc are smaller than xl and yl, the lower right starting pointer BPS3 (Fig. 
Ji-^ 27 (c)) will be selected and stored. When xc is the same as or larger than xl and 

5 - ; 

yc is smaller than yl, the lower left starting pointer BPS4 (Fig. 27 (d)) is selected 
:|i ^ and stored. 

m 

Thus, in accordance with the coordinates specijBed for the points SP and 
ui 15 CP, a pointer image is selected that expands from the embellishment image 
UJ starting point SP in a direction that can be ascertained from the positional 

relationship between the point SP and BP. This makes it easy for a user to 
ascertain and specify the desired location of the box image overlay. The memory 
224 contains starting pointers BPS and box coordinate pointers BP for each of the 
20 image conditions such as color that can be set. User can easily ascertain the 
image condition to be set. Moreover, a box coordinate pointer BP also may be 
selected from among the four box coordinate pointers oriented in each direction 
that makes it possible to ascertain the shape of the embellishment image 
specified by the pointers BPS and BP, based on the positional relationship 
25 between the points SP and CP. In this way, user can ascertain box image more 
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easily. 

C-4. Marker images: 

Figs. 28(a)-(c), 29(a)-(c) and 30(a)-(c) are diagrams for explaining the 
5 process of overlaying an original image with a marker image. Fig. 28 (a) shows 
the data stored in the embellishment image expansion memory 226, Fig. 28 (b) 
shows the data stored in the embellishment image drawing memory 227, and Fig. 
28 (c) shows the image as it appears on the projection screen 104. 

To superimpose a marker image on an original image, first the marker 

10 image display function is called by pressing a pre-assigned key on the remote 

controller 29. The marker embellishment image is a line image that connects two 
point on the display screen, referred to as the marker images. Marker image 
conditions are set beforehand using menu screens such as those shown in Fig. 19. 
These menus are used with the remote controller 29 to select line color, width, 

15 whether the image is semitransparent or opaque, and so forth. A selection of 
different line types such as a dashed line, a chain line and a wavy line can also 
be provided. The system can be configured so that a menu is displayed each time 
the marker image display key is pressed, to set the image conditions. The 
marker image conditions may be set according to menus and may be stored in the 

20 embelUshment image expansion memory 226. 

When the marker image display function is initiated, marker pointer MP 
image data for specifying the coordinates of the marker image is read out of the 
embelUshment image storage memory 224 and placed in the embellishment 
image expansion memory 226. The memory 224 contains multiple sets of image 

25 data corresponding to each image condition. 
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When the marker image display function is initiated, the image data (for 
example, pen image data) corresponding to the selected image conditions such as 
line width and color is stored in the memory 226. This marker pointer MP image 
data includes marker pointer image information, prescribed marker image 
5 bitmap data, and image display coordinate data (xc, yc). The marker pointer MP 
image data is displayed on the projection screen 104, superimposed on the 
original image data stored in the frame memory 222 at a position CP given by the 
coordinates (xc, yc), as shown in Fig. 28 (c). As can be seen in Fig. 28 (b), at this 
point the memory 227 is empty. 
10 Using the above-described pointing device, the coordinates (xc, yc) of 

pointer display position CP can be moved to any point desired. At the desired 
position, the coordinates (xl, yl) of a starting point SP at an end point of the 
marker image are specified by pressing the enter button on the remote controller 



display at the specified starting point SP, in addition to the marker pointer MP, 
as shown in Fig. 29 (c). For this, the image data for the starting pointer MPS and 
for the marker pointer MP are read out of the embellishment image storage 
memory 224 and into the embelUshment image expansion memory 226. The two 

2 0 sets of image data include data relating to the color and other preset image 
conditions. The images of the pointers MPS and MP displayed on the screen 
reflect the colors and other conditions set for the marker image. The pointing 
device is then used to move the marker pointer MP to specify the coordinates of 
the end point EP at the other end of the marker image. In this way, the 

25 coordinates (xl, yl), (x2, y2) defining the two points SP and EP of the marker 



29. 
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When this is done, an image of a starting pointer MPS appears on the 
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image are set, to be utilized when the CPU 20 draws the marker image. At this 
point too, as can be seen from Fig. 29 (b), the memory 227 contains nothing until 
the end point EP coordinates are specified. A starting point cancel key can be 
used to cancel the starting point setting. 
5 When the starting and end points SP and EP have thus been specified, a 

marker image drawn by the CPU 20 in accordance with the preset line width, 
color and other image conditions is stored in the memory 227 (Fig. 30 (b)). At the 
same time, the image data of the starting pointer MPS in memory 226 is erased 
and vanishes from the projection screen 104. The marker image data in the 

1 0 memory 227 is superimposed on the original image data in the frame memory 
222 and the resulting image displayed on the projection screen 104 (Fig. 30 (c)). 
Multiple marker images can be superimposed on the original image by repeating 
the above procedure the necessary number of times. The example illustrated in 
Figs. 28(a)-(c), 29(a)-(c) and 30(a)-(c) is that of a marker extended horizontally, 

15 but the marker can also be drawn vertically. The coefficients k3, k4 applied by 
the multipliers 276, 278 (Fig. 17) can be set at (1, 0) to have the display of the 
starting pointer MPS vanish from the screen while still retaining the image data 
in the memory 226. Alternatively, the starting pointer MPS can be removed fi-om 
the screen by halting the readout of the image data from the memory 226. 

2 0 As the starting pointer MPS, an image can be selected that exhibits the 

width, direction and color of the marker pointer MP. In Fig. 29(a)- (c), the 
starting pointer MPS is shown as an image corresponding to part of the marker 
drawn from the starting point. The apex of the triangle indicates the direction 
of the marker pointer MP. 

25 
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C-5. Line images: 

Figs. 31(a)-(c) and 32(a)-(c) are diagrams for explaining the process of 
overlaying an original image with a line image. Fig. 31 (a) shows the data stored 
in the embellishment image expansion memory 226, Fig. 31 (b) shows the data 
stored in the embellishment image drawing memory 227, and Fig. 31 (c) shows 
the image as it appears on the projection screen 104. 

To superimpose a line image on an original image, first the Une image 
display function is initiated by pressing a pre-assigned key on the remote 
controller 29. The line embelUshment is a line image that extends horizontally 
all the way across the screen, referred to as the line image. Line image 
conditions are set beforehand using menu screens such as those shown in Fig. 19. 
These menus are used with the remote controller 29 to select line color, line 
width, whether the image is semitransparent or opaque, and so forth. A selection 
of different line types can be provided. The system can be configured so that a 
menu is displayed each time the line image display key is pressed, to set the 
image conditions. The line image conditions may be set according to menus and 
may be stored in the embelUshment image expansion memory 226. 

When the line image display function is initiated, line pointer LP image 
data for specifying the coordinates of the line image is read out of the 
embelUshment image storage memory 224 and placed in the embeUishment 
image expansion memory 226. The memory 224 contains multiple sets of line 
pointer image data corresponding to each image condition. 

When the line image display function is initiated, the image data (for 
example, line image data) corresponding to the selected image conditions such 
as line width and color is stored in the memory 226. This Une pointer LP image 
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data includes line pointer image information, prescribed line image bitmap data, 
and display coordinate data (yc). The image of the line pointer LP is displayed 
on the projection screen 104, superimposed on the original image data stored in 
the frame memory 222 at the position denoted by the coordinate (yc), as shown 
5 in Fig. 31 (c). As shown by Fig. 31 (b), at this point there is nothing in memory 
227. 

The above-described pointing device is used to move the line pointer 
coordinate (yc) vertically to the required position. The position coordinate (yl) 
is then specified by pressing the enter button on the remote controller 29. 

10 When the line image position has thus been specified, the image data of 

the line pointer LP is copied to the memory 227, where it is stored at the position 
corresponding to the coordinate (yl), and with the selected width and color. Line 
image data is stored in the memory 227. The Une image in the memory 227 is 
superimposed on the original image data in the frame memory 222 and the 

15 resulting image displayed on the projection screen 104, as shown in Fig. 32 (c). 
In this way, a line image can be superimposed on an original image. Multiple 
line images can be superimposed on the original image by repeating the above 
procedure the necessary number of times. 

The image data for the line pointer LP stored in the memory 224 relates 

20 only to line width and length. The embellishment image expansion memory 226 
can be used to develop line image data corresponding to the width of the screen 
and the selected line width. 

C-6. Erasing embelUshment images: 
2 5 EmbelUshment images superimposed on original images can be erased 
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from the screen 104 by flushing the embelUshment image data stored in the 
memories 226 and 227. In order to re-display the same embelUshment images 
once this has been done, it is necessary to again select the images and set the 
related conditions. Another way of removing embellishment images from the 
5 screen is to set the coefficients kl, k2, k3, k4 of the embellishment overlay circuit 
212 to (1, 0, 1, 0) to prevent the embellishment images read out of the memories 
226 and 227 being superimposed on the original image. Alternatively, reading 
out may be stopped. Since in this case the embellishment image data would still 
be retained in the memories 226 and 227, they could again be displayed whenever 
^ 1 0 required. 

The projection display apparatus of the third embodiments described in 
the foregoing is able to internally superimpose embellishment images on original 
images received as input. This means that the projection display apparatus can 
superimpose embellishment images on image signals output by video recorders 
15 and TVs as well as personal computers. Moreover, pointer images used for 
setting box and marker images are displayed using icons that indicate the type 
(shape), color, line width, the positional relationship between two designated 
points and other such display conditions of the images selected, which makes it 
easy for a user to control the superimposition of embellishments on original 
^20 images. 

As can be understood from the foregoing explanation, the video signal 
conversion circuit 210, embellishment overlay circuit 212, remote control section 
28 and CPU 20 of this embodiment correspond to the image embellishment 
section in the second projection display apparatus of this invention. And CPU 20 
25 corresponds to the drawing section in the second projection display apparatus of 
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this invention. 

The present invention is in no way Umited to the details of the examples 
and embodiments described in the foregoing but various changes and 
5 modifications may be made without departing from the scope of the appended 
claims. For example, the following modifications are also possible. 

In the case of the first embodiment, the data selector 64 shown in Fig. 14 
could be used to superimpose the embellishment images instead of the two 
multipliers 40 and 42 and the adder 44 used in the embellishment overlay circuit 
10 12 (Fig. 4). This would enable the embellishment images to be given a fiUed-in 
(solid) effect equivalent to the effect obtained when coefficients (kl, k2) of the 
multipliers 40, 42 are set at (1, 0) or (0, 1). Conversely, in the case of the second 
embodiment the multiphers 40 and 42 and the adder 44 could be used to 
superimpose the embellishment images instead of the data selector 64. This 
15 would enable transparent embellishment images as well as fiUed-in ones. 

Again, in the case of the two multipliers 40 and 42 and the adder 44 used 
by the circuit 12 to superimpose embellishments in the first embodiment, if kl 
and k2 are both set at 1/2 to provide transparent images, the multiphers 40 and 
42 do not need to be used. Instead, the same effect can be used by effecting a bit 
20 shift in the adder 44 to remove the low-order bit fi:om the data that is added. 

In the first and second embodiments, when memory capacity equivalent 
to one frame of image data is allocated for expanding embellishment images, as 
shown in Fig. 6, the same effect can be obtained by using one-frame flags in place 
of coordinate data. For example, the pixel data of an embeUishment graphic in 
25 the embellishment effect bitmap data could be provided with a one-bit flag that 
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could be used to determine the presence or absence of the graphic. Depending on 
the presence or absence of the flag, an adjustment could be made to the 
coefficients kl, k2 of the multipliers 40, 42, in the case of the first embodiment, 
or to the selection by the data selector 64, in the case of the second embodiment. 
5 In this way, the same effect could be obtained as when coordinate data is used. 

In the first and second embodiments, embellishment effect bitmap data 
BMDl is expanded and stored in the embellishment effect bitmap memory 26 or 
embellishment effect memory 24, this expansion is not limited to the memories 
26 and 24 but may be effected in other storage areas prepared for the purpose. 

1 0 The pointer images described in the third embodiment are examples and 

are not limitative, there being various other pointer images that can be applied 
to obtain the same type of effect. 

The various types of memory used in the three embodiments, such as, the 
frame memory 222, embellishment image storage memory 224, embellishment 

15 image expansion memory 226 and embellishment image drawing memory 227 of 
the third embodiment can be configured with independent memory address 
spaces and controlled independently. Also, each could be defined as a memory 
area in a shared address space controlled by the CPU 20. 

In the first and second embodiments a hquid crystal display panel 16 is 

2 0 used as the light modulation unit of the projection display apparatus, but the 
invention is not limited to this and can use as the light modulation unit any unit 
that is able to modify luminance according to the image data. For example, a 
light modulation unit can be used that utilizes light reflected by a pixel array of 
mirror elements, or a CRT or plasma display panel or the like. Similarly, the 

2 5 electro-optical device used in the third embodiment is not Umited to the Hquid 
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crystal light valve 216, with various other devices being usable for the same 
purpose such as a digital micromirror device (DMD, trademark of Texas 
Instruments Inc.), CRT or plasma display panel. 

The first to third embodiments have been described using a projection 
5 display apparatus as an example, but this is not limitative, with the invention 
being applicable to various other types of image display apparatus. In the case 
of such other displays, the light valve or other such light modulation unit used 
by the projection display apparatuses would function as an image display 
apparatus that displays images directly. 
10 In the described embodiments, part of the configuration implemented by 

hardware can instead be implemented by software and, conversely, part of the 
configuration implemented by software can instead by implemented by hardware. 



Industrial ApplicabiUty 
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The present invention is applicable to a variety of image display 



apparatuses. The projection display apparatuses of the present invention is 



applicable to projecting onto a screen images input by such as a computer and 



a video recorder. 
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